Narrowing confidence interval width of PAC learning risk function by algorithmic inference

نویسندگان

  • Bruno Apolloni
  • Dario Malchiodi
چکیده

We narrow the width of the confidence interval introduced by Vapnik and Chervonenkis for the risk function in PAC learning boolean functions through non-consistent hypotheses. To obtain this improvement for a large class of learning algorithms we introduce both a theoretical framework for statistical inference of functions and a concept class complexity index, the detail, that is dual to the Vapnik-Chervonenkis dimension. Detail of a class and maximum number of mislabelled points add up linearly to constitute the learning problem complexity. The sample complexity dependency on this index is almost similar to the one on VC dimension. We formally prove that the former leads to confidence intervals for the risk function that are definitely narrower than in the latter.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Narrowing confidence interval width of SVM learning risk function by algorithmic inference

We narrow the width of the confidence intervals introduced by Vapnik for the risk function in Support Vector Machine learning [12]. We obtain this improvement by introducing both a theoretical framework for statistical inference of functions and a concept class complexity index, the detail, that is dual to the Vapnik-Chervonenkis dimension [4]. Detail of a class and maximum number of mislabelle...

متن کامل

Bayes Interval Estimation on the Parameters of the Weibull Distribution for Complete and Censored Tests

A method for constructing confidence intervals on parameters of a continuous probability distribution is developed in this paper. The objective is to present a model for an uncertainty represented by parameters of a probability density function.  As an application, confidence intervals for the two parameters of the Weibull distribution along with their joint confidence interval are derived. The...

متن کامل

Position Control of a Pulse Width Modulated Pneumatic Systems: an Experimental Comparison

In this study, a new adaptive controller is proposed for position control of pneumatic systems. Difficulties associated with the mathematical model of the system in addition to the instability caused by Pulse Width Modulation (PWM) in the learning-based controllers using gradient descent, motivate the development of a new approach for PWM pneumatics. In this study, two modified Feedback Error L...

متن کامل

Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Monte Carlo methods are used to approximate the means, μ , of random variables Y , whose distributions are not known explicitly. The key idea is that the average of a random sample, Y1, . . . ,Yn, tends to μ as n tends to infinity. This article explores how one can reliably construct a confidence interval for μ with a prescribed half-width (or error tolerance) ε . Our proposed two-stage algorit...

متن کامل

Algorithmic Stability and Uniform Generalization

One of the central questions in statistical learning theory is to determine the conditions under which agents can learn from experience. This includes the necessary and sufficient conditions for generalization from a given finite training set to new observations. In this paper, we prove that algorithmic stability in the inference process is equivalent to uniform generalization across all parame...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002